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Abstract. We study two-player games of infinite duration that are played on finite or 
infinite game graphs. A winning strategy for such a game is positional if it only depends on 
the current position, and not on the history of the play. A game is positionally determined 
if, from each position, one of the two players has a positional winning strategy. 

The theory of such games is well studied for winning conditions that are defined in terms 
of a mapping that assigns to each position a priority from a finite set C. Specifically, in 
Muller games the winner of a play is determined by the set of those priorities that have 
been seen infinitely often; an important special case are parity games where the least 
(or greatest) priority occurring infinitely often determines the winner. It is well-known 
that parity games are positionally determined whereas Muller games are determined via 
finite-memory strategies. 

In this paper, we extend this theory to the case of games with infinitely many priorities. 
Such games arise in several application areas, for instance in pushdown games with winning 
conditions depending on stack contents. 

For parity games there are several generalisations to the case of infinitely many pri- 
orities. While max-parity games over uj or min-parity games over larger ordinals than u 
require strategies with infinite memory, we can prove that min-parity games with priorities 
in uj are positionally determined. Indeed, it turns out that the min-parity condition over u> 
is the only infinitary Muller condition that guarantees positional determinacy on all game 
graphs. 



1. Motivation 

The problem of computing winning positions and winning strategies in infinite games 
has numerous applications in computing, most notably for the synthesis and verification of 
reactive controllers and for the model-checking of the /i-calculus and other logics. Of special 
importance are parity games, due to several reasons. 
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(1) Many classes of games arising in practical applications admit reductions to parity 
games (over larger game graphs). This is the case for games modeling reactive systems, 
with winning conditions specified in some temporal logic or in monadic second-order 
logic over infinite paths (SIS), for Muller games, but also for games with partial 
information appearing in the synthesis of distributed controllers [Q. 

(2) Parity games arise as the model checking games for fixed point logics such as the 
modal /z-calculus or LFP, the extension of first-order logic by least and greatest fixed 
points PlOi]. In particular the model checking problem for the modal ^-calculus 
can be solved in polynomial time if, and only if, winning regions for parity games can 
be computed in polynomial time. 

(3) Parity games are positionally determined I24j. This means that from every posi- 
tion, one of the two players has a winning strategy whose moves depend only on the 
current position, not on the history of the play. This property is fundamental for nu- 
merous results in automata theory on infinite objects and for verification algorithms. 

In most of the traditional applications of games in computer science, the arena, and 
therefore also the number of priorities appearing in the winning condition, are finite. How- 
ever, due to applications in the verification of infinite-state systems and other areas where 
infinite structures become increasingly important, it is interesting to study infinite arenas 
that admit some kind of finite presentation. The best studied class of such games are 
pushdown games [12 1 1 I28| , where the arena is the configuration graph of a pushdown au- 
tomaton. Other relevant classes of infinite, but finitely presented, (game) graphs include 
prefix-recognizable graphs, HR- and VR-equational graphs, graphs in the Caucal hierarchy, 
and automatic graphs. On all these classes of graphs (with the exception of automatic 
graphs [2|), monadic second-order logic can be evaluated effectively, which implies, for in- 
stance, that winning regions of parity games with a finite number of priorities are decidable. 
However, once we move to infinite game graphs, winning conditions depending on infinitely 
many priorities arise naturally. In pushdown games, stack height and stack contents are 
natural parameters that may take infinitely many values. In [Jj, Cachat, Duparc, and 
Thomas study pushdown games with an infinity condition on stack contents, and Bouquet, 
Serre, and Walukiewicz [£] consider more general winning conditions for pushdown games, 
combining a parity condition on the states of the underlying pushdown automaton with 
an unboudedness condition on stack heights. Similarly, Gimbert J2] considers games of 
bounded degree where the parity winning conditions is combined with the requirement that 
an infinite portion of the game graph is visited. 

To establish positional determinacy or finite-memory determinacy is a fundamental 
first step in the analysis of an infinite game, and is also crucial for the algorithmic con- 
struction of winning strategies. In the case of parity games with finitely many priorities the 
positional determinacy immediately implies that winning regions can be decided in NP n 
Co-NP; with a little more effort it follows that the problem is in fact in UP D Co-UP |17j . 
Further, although it is not known yet whether parity games can be solved in polynomial 
time, all known approaches towards an efficient algorithmic solution make use of positional 
determinacy, including the presently best deterministic algorithm from |19| . The same is 
true for the polynomial-time algorithms that we have for specific classes of parity games, 
including parity games with a bounded number of priorities ^H], games where even and 
odd cycles do not intersect, solitaire games and nested solitaire games and parity games 
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of bounded tree width bounded entanglement @], or bounded DAG-width [2J[2S]. Po- 
sitional determinacy is also the key point in the proofs of most of the known results on 
pushdown games. 

In general, the positional determinacy of a game may depend on specific properties 
of the arena and on the winning condition. For instance, the previously known results 
on pushdown games make use of the fact that the arena is a pushdown graph. However, 
this is not always the case. As we show here, there are interesting cases, where positional 
determinacy is a consequence of the winning condition only. Most notably this is the case for 
the parity condition (little endian style) on uj. In fact, we completely classify the infinitary 
Muller conditions with this property and show that they are equivalent to a parity condition. 
This result gives a general, arena-independent explanation of the positional determinacy of 
certain pushdown games. We hope and expect that it will be the first step for algorithmic 
solutions for other infinite games with finitely presented arenas. 

2. Introduction 

2.1. Games and strategies. We study two-player games of infinite duration on arenas 
with infinitely many priorities. An arena Q = (V, Vo, V±, E, Q), consists of a directed graph 
(V, E), with a partioning V = VbU Vi of the nodes into positions of Player and positions of 
Player 1. The possible moves are described by the edge relation E C V x V . The function 
: V — > C assigns to every position a priority. Occasionally we encode the priority function 
by the collection (P c ) cg c of unary predicates where P c = {v 6 V : Q(v) = c}. 

In case (v, w) € E we call w a successor of v and we denote the set of all successors 
of v by vE. To avoid tedious case distinctions, we assume that every position has at least 
one successor. A play of Q is an infinite path vqV\ . . . formed by the two players starting 
from a given initial position vq. Whenever the current position v n belongs to V a , then 
Player a chooses a successor v n +i € v n E. A game is given by an arena and a winning 
condition that describes which of the plays vqv\ . . . are won by Player 0, in terms of the 
sequence Q(vq)Q(vi) ... of priorities appearing in the play. Thus, a winning condition is a 
set W C of infinite sequences of priorities. 

A (deterministic) strategy for Player a is a partial function / : V*V a — ► V that assigns 
to finite paths through Q ending in a position v € V a a successor w 6 vE. A play vqV\ • • • € 

is consistent with / if, for each initial segment Vq . . . Vi with V{ 6 V a , we have that 
Vi + \ = /(vq . . . Vi). We say that such a strategy / is winning from position vq if every play 
that starts at Vq and that is consistent with / is won by Player a. The winning region of 
Player a, denoted W a , is the set of positions from which Player a has a winning strategy. 
A game Q is determined if Wq U W\ = V, i.e., if from each position one of the two players 
has a winning strategy. 

Winning strategies can be rather complicated. Of special interest are simple strategies, 
in particular finite memory strategies and positional strategies. While positional strategies 
only depend on the current position, not on the history of the play, finite memory strategies 
have access to bounded amount of information on the past. Finite memory strategies can 
be defined as strategies that are realisable by finite automata. 

More formally, a strategy with memory M for Player a is given by a triple (mo, U, F) 
with initial memory state m,Q 6 M, a memory update function U : M x V — > M and a 
next-move function F : V a x M — > V . Initially, the memory is in state mo and after the 
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play has gone through the sequence vqv± . . . v m the memory state is u(vo . . . v m ) , defined 
inductively by u(vo . . . v m v m+ i) = U(u{vq . . . v m ), v m+ \). In case v m G V a , the next move 
from v\ . . . v m , according to the strategy, leads to F(v m ,u(vo . . . , v m )). In case M = {mo}, 
the strategy is positional; it can be described by a function F : V a — > V. 

Definition 2.1. A game is positionally determined, if it is determined, and each player has 
a positional winning strategy on his winning region. 

Clearly, if the arena is a forest, then all strategies are positional, so the game is posi- 
tionally determined if, and only if, it is determined. 

Throughout the paper, we assume the Axiom of Choice. 

2.2. Games with infinitely many priorities. In the context of finite-memory determi- 
nacy or positional determinacy of infinite games it is usually assumed that the range of the 
priority function is finite, and the winning condition is defined by a formula on infinite paths 
(from SIS or LTL, say) referring to the predicates (P c ) cg c*, or by an automata-theoretic 
condition like a Muller, Rabin, Streett, or parity (Mostowski) condition (see e.g. [Tl)l I§1 12*§] ) . 
In Muller games the winner of a play depends only on the set of priorities that have been 
seen infinitely often; it has been proved by Gurevich and Harrington JB] that Muller games 
are determined and that the winner has a finite-memory winning strategy. An important 
special case of Muller games are parity games where the least (or greatest) priority occurring 
infinitely often determines the winner. 

Here we will extend the study of positional determinacy to games with infinitely many 
priorities. Specifically we are interested in games with priority assignments : V — > uj. 
Besides the obvious theoretical interest, such games arise in several areas. For instance, 
the winning conditions of pushdown games are specific instances of abstract winning con- 
ditions in games with infinitely many priorities. It is interesting to study these games in a 
general setting, and to isolate the winning conditions that lead to positional determinacy 
on arbitrary arenas, not just on specific ones like pushdown games. 

Based on priority assigments : V — ► uj we will first consider the following classes of 
games. 

Infinity games: are games where Player wins precisely those infinite plays in which 

no priority appears infinitely often. 
Parity games: are games where Player wins the infinite plays where the least pri- 
ority seen infinitely often is even, or where all priorities appear only finitely often. 
Max-parity games: are games where Player wins if the maximal priority occurring 

infinitely often is even, or does not exist. 
Note that we have chosen the definitions so that in case no priority appears infinitely 
often, the winner is always Player 0. It is clear that these games are determined, because 
the winning conditions are Borel sets, and a fundamental result due to Martin [22] states 
that all Borel games are determined. To be more precise, the infinity and parity winning 
conditions are on the Fig-level of the Borel hierarchy. Indeed, note that for any m G uj 
the set A m of words that contain infinitely many occurences of m is in III] since it is the 
countable intersection of the open sets A^ := (uj*m) n uj UJ , for all n G uj. Now the parity 
condition can be expressed as the the set of infinite words x = xqX\X2 ■ ■ ■ such that for all 
odd m, either x A m or there is an even number k < m such that x G A^. Similarly, it is 
easy to see that the max-parity condition is on the A^-level of the Borel hierarchy. 
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For games with only finitely many priorities, min-parity and max-parity winning con- 
ditions can be (and are) used interchangeably. This is not the case when we have infinitely 
many priorities. 

Proposition 2.2. Max-parity games with infinitely many priorities in general do not admit 
finite memory winning strategies. 

Proof. Consider the max-parity game with positions Vo = {0} and V\ = {2n + 1 : n £ N} 
(where the name of a position is also its priority), such that Player can move from to 
any position 2n + 1 and Player 1 can move back from 2n + 1 to 0. Clearly Player has a 
winning strategy from each position but no winning stategy with finite memory. □ 

However, we will see that (min-)parity games with priorities in u are positionally de- 
termined. 

2.3. Strategy forests. Let / be a strategy for Player a in the game Q = (V, Vo, V\, E, f2). 
For any initial position vq of the game, we can associate with / the strategy tree Tf, the 
tree of all plays that start at vq and that are consistent with /. In the obvious way, Tf 
can itself be considered as a game graph, with a canonical homomorphism h : Tf — > Q. For 
every position v of Q, we call the nodes s 6 h~ l {v) the occurrences of v in Tf. Since we 
assume that strategies are deterministic every occurence of a node v S V a has precisely one 
successor in the strategy forest 7j, whereas every occurrence of a node v E V\ has precisely 
as many successors in Tf as v has in Q. If / is a winning strategy from vq, then every path 
through Tf is a winning play for Player a. If we consider a set of initial positions (like the 
entire winning region W a ) then Tf is a strategy forest with a separate tree for each initial 
position. 

By moving from game graphs to strategy forests we can eliminate the interaction be- 
tween the two players and thus simplify the analysis. We already know that the games that 
we study are determined. To prove positional determinacy we proceed as follows. 

We take a winning strategy and define a collection of well-founded pre-orders on its 
strategy forest. We then define a positional winning strategy for the original game, by 
copying for each position in the winning region, the winning stategy from a minimal oc- 
currence of the position in the strategy tree. We then show that the resulting positional 
strategy is indeed winning. 

To simplify the exposition we first discuss infinity games. Note that these can be seen 
as a special case of parity games. Indeed, if we change the priorities of an infinity game Q 
so that all priorities become odd, by setting Q'(v) := 20(f) + 1, and replace the infinity 
winning condition by the parity condition, then the resulting parity game Q' is equivalent 

to g. 

3. Infinity Games 

We start with some remarks on arbitrary transition systems. We will then apply them 
to strategy forests. 

Given any transition system K, = (S, E, P) with set of states S, transition relation E 
and atomic proposition P, we assign to each state s an ordinal a(s) or oo. Informally, a(s) 
tells us how often a path from s can hit P. To define this precisely, we proceed inductively. 
For any ordinal a, let X a be the set of all s S S such that whenever a path from s hits a node 
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t G P, then all successors of t belong to U/3< Q ^ ■ Finally, let a(s) = min{a : s G X a }. If 
s is not contained in any X a , the we put a(s) = oo. 

Remark. We can equivalently define a(s) in terms of closure ordinals in the modal \x- 
calculus. Consider the formula (iX.(p(X), with <p(X) := vY.(P — > OX) A OY. It expresses 
that on all paths, there are only finitely many occurrences of P. We define the stage 
X a of the least fixed point induction via (p(X) by X a = {s : IC,s \= ip(X <a )} where 
X <a := U/3<q X ■ ^ i s easily seen that this coincides with the definition given above. 

Remark. Note that although fiX.ip(X) expresses that on every path there are only finitely 
many occurrences of P the closure ordinals need not be finite. For a simple example, 
consider an infinite path vqV\V2 ■ ■ ■ without occurences of P and attach to each v n another 
infinite path on which P is seen precisely n times. On all these attached paths, a(s) will 
take only finite values, but a(v n ) = u for all n. 

The following lemma is a direct consequence of the definitions. 

Lemma 3.1. Suppose that every path in fC contains only finitely many occurrences of P 
(i.e., JC,s \= (j,X.(p(X) for all s). Then a(s) > a(t) for all edges (s,t) of K,, and the 
inequality is strict for s G P. 

Assume next that we have a transition system K = (S, E, Pq, Pi, P2, . . .) with infinitely 
many atomic propositions P n . Proceeding as above for P n instead of P, we obtain, for 
each n, a function a n mapping states s G S to ordinals. The signature of s is sig(s) : = 
(a n (s) : n < u); we compare signatures lexicographically. Further, for each n < co, let 
sig n (s) = (ao(s), . . . , a n (s)) and let s < n t denote that sig n (s) < sig n (t) (i.e., that the 
signature of s is strictly smaller than the signature of t on the first n+1 positions). Similarly, 
let s < n t denote that sig n (s) < sig n (t). 

Note that s < n t implies s < n +i t and that each pre-order < n is well-founded (i.e., 
all descending chains are finite). On the other side, when we have infinitely many P n , the 
lexicographic order of unrestricted signatures admits infinite descending chains. 

Theorem 3.2. Infinity games are positionally determined 

Proof. Let W$ and W\ be the winning regions of the two players for the infinity game on 
the arena Q. Note that the situation for the two players is not symmetric, so we have to 
consider them separately. 

Let / be any winning strategy for Player on Wq. If / is positional then we are done. 
Otherwise, we consider the strategy forest 7j and the canonical homomorphism h : Tf — > Q . 
In 7j every path is winning for Player 0, and thus hits each P n only finitely often. Hence 
the functions a n (s) are defined and satisfy the properties of Lemma 13.11 

We define a positional strategy /' for Player as follows. Select a function s : Wo — > Tf 
that associates with each vertex v G Wo of priority n a < n -minimal element s(v) G h~ l {y) 
(i.e., a < n -minimal occurrence of v in the strategy forest). If v, and hence also s(v), is 
a node of Player 0, then there is a unique successor t of s(v) in Tf, define f'(v) := h(t). 
Further, we define values of a n (and hence sig n ) on Wo by a n (v) := a n (s(v)). 

We claim that /' is winning from each node vo G Wo- Otherwise there exists a play 
V0V1V2 ■ ■ ■ that is consistent with /' and winning for Player 1. Let n be the least priority 
seen infinitely often on this play; take a suffix of the play on which priorities smaller than 
n do no longer occur. We claim that the values of sig n never increase on this suffix. 

To see this, consider a move from v to w in this suffix and the corresponding moves in Tf 
from s := s(v ) to t with h(t) = w. By construction, and since v and w have priorities > n, 
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we have sig n (v) = sig n (s) and sig n (w) < sig n (t). By Lemma IXT1 we have a m (s) > a m (t) 
for all to and the inequality is strict if to is the priority of s. It follows that 

sign(^) = sigjs) > sig n (t) > sig„(w) 

and sig n (v) > sig n (w) in case v 6 P n - Since there are infinitely many nodes Vi ± ,Vi 2 , ... of 
priority n in the suffix, we obtain an infinite descending chain 

sig„(^ii) > sig n (v i2 ) > ••• 
which is impossible. Hence /' is indeed a winning strategy. 

We now consider the case of Player 1. Let g be a strategy for Player 1 on W±, with 
strategy forest T g and canonical homomorphism h : T g — > Q. We define the 0-ancestor of 
a node s € T g to be the closest ancestor of s that has priority 0. Note that 0-ancestors 
may be undefined. More generally, the m-ancestor of s is the closest ancestor of priority 
to, provided it lies between s and the j-ancestor of s, for all j < to for which the j- 
ancestor is defined. We can thus associate with every node s of priority to an (to + l)-tuple 
a(s) = (ao(s), . . . ,a m (s)) € (T g U {_L}) m+1 of ancestors, where Oj(s) = _L means that the 
i-th ancestor of s is not defined. Observe that a m (s) = s as s is an ancestor of itself. 

We fix a well-order < on T g U {_L} (with maximal element _L) and we compare tuples 
of ancestors via the lexicographical order that is induced by <. We can then associate with 
every v G W\ of priority m the node s(v) £ h~ l (v) with the minimal tuple of ancestors. 
Note that s(v) is well-defined, because every position v € W\ has at least one occurrence 
s € T g , and a m (s) = s if m has priority to (so at least one ancestor is defined). We extend 
the ancestor function to W\ by setting a(v) := a(s(v)); this assigns to every node in W\ a 
tuple of ancestors in T g . To define the positional strategy g' , we select for any v G V\ D W\ 
the unique successor t of s(v) and set g'(v) := h(t). 

We claim that this strategy is winning for Player 1. Suppose conversely that there 
is a losing play respecting the strategy. Then no priority appears infinitely often on this 
play. Consider the suffix of the play after the last appearance of priority 0. Let us look at 
the 0-ancestors of the positions in this suffix. These ancestors can only get smaller as the 
play proceeds. Indeed a move from v to w in such a play corresponds to a move from s(v) 
to t in T g with h(t) = w. Since w does not have priority 0, ao(s) = ao(t) and therefore 
oo(f) = ao(s) = ao(t) > ao(w). This means that from some moment on all positions in the 
play will have the same 0- ancestor. Consider the suffix of the play consisting only of these 
vertices. Next do the same with priority 1. We find a position after which the 1-ancestor 
stabilises. Observe that it is a descendant of the 0- ancestor and that there is no occurrence 
of priority on the path between the two. Proceeding in this way we construct a path in 
the strategy tree T g on which no priority appears infinitely often. But this is impossible, 
since g was a winning strategy for Player 1. □ 

4. Parity games 

For parity games we proceed quite similarly, but we have to consider more complicated 
orderings on the strategy forests. 

Consider a transition system fC = (S, E, P, Q) with two atomic propositions P and Q. 
We assign to each state s an ordinal f3(s) or oo which, informally, tells us how often a path 
from s can hit P before seeing Q. Let X° be the set of all s such that all paths from 
s hit Q before hitting P, and for [3 > 0, let X@ be the set of all s such that whenever 
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a path from s hits a node t G P, then all successors of t belong to X < @. Finally, let 
(3(s) = min{/3 : s G X?}. 

Again, we have an equivalent definition in terms of the modal //-calculus. This time, 
consider the formula fj,X.(p(X), with ip(X) := uY.(^P V DX) A(QV DY). It expresses that 
on all paths, there are only finitely many occurrences of P before seeing Q. Then is 
the stage at which the least fixed point induction defined by <p(X) becomes true at node s. 

Lemma 4.1. Suppose that every path in KL contains only finitely many occurrences of P 
before hitting Q. Then (3{s) > (5{t) for all edges (s,t) of fC with s Q, and the inequality 
is strict for s G P. 

For infinity games we have defined ordinals a n (s) telling us how often a path from 
s can see priority n, independently for each n. Now we need different bounds f3 n which, 
informally, describe how often a path can hit the odd priority n before seeing a smaller one. 

Let Q be a parity game, and let 7/ = (S, E, Pq, P±, P2, . . .) be the strategy forest of a 
winning strategy / for Player 0. Note that for every odd priority n, each path through Tf 
sees only finitely many occurrences of n before seeing a priority < n. Hence, proceeding as 
above for P := P n and Q := \J m<n P m we obtain, for each odd n, a function n mapping 
nodes s G Tf to ordinals. The O-signatures of s are sig°(s) := (/3i(s), /^(s) . . . , /3 n /(s)), 
where n' = n for odd n and n' = n — 1 for even n; let s <^ t denote that sig^(s) < sig^(t). 
Further, s <° t means that sig°(s) < sig°(i). 

For strategy forests T g of winning strategies of Player 1, we proceed dually, associat- 
ing with every node s ordinals j3 n (s), for even n. We then define 1-signatures sig^(s) = 
(/3q(s), 02 {s), ■ ■ ■ > Pn'(s)) (where n' is the largest even number not exceeding n) and the 
corresponding signature orderings <\. 

Again, we immediatley see that s < % n t implies s <* l+1 t and that each < % n is a well- 
founded. Further, these orderings have very useful properties on strategy forests. 

Lemma 4.2. Let Tf be the strategy forest associated with a winning strategy for Player 
for a parity game. Then t <q/ s j s for all edges (s,t) of Tf and the inequality is strict if 
fi(s) is odd. In a strategy forest T g of Player 1, we have t <q/ s \ s for all edges (s,t) and 
the inequality is strict if£l(s) is even. 

Proof. If (s,t) is an edge in Tf, then by Lemma I4TT1 (3 m (t) < j3 m {s) for m < £l(s), and, if 
n = fl(s) is odd, and f3 n (t) < f3 n (s). Similarly for T g . □ 

Theorem 4.3. Parity games with priorities in uj are positionally determined. 

Proof. The proof for Player is precisely the same as for infinity games, using O-signatures 
and the associated orderings <°. 

For Player 1 we combine the approach for infinity games based on ancestors in the 
strategy forest with comparisons based on 1-signatures. As in the proof of Theorem 13.21 
we associate with every node s of priority m in the strategy tree T g the (m + l)-tuple 
a(s) = (ao(s), . . . , a m (s)) G (T g U {_L}) m+1 of ancestors. 

For each i G u we fix a well-order <$ extending <\. Moreover we assume that _L is 
bigger in the <j-order than all the nodes. Let s, s' be two nodes of T g of the same priority 
m. We write s < m s' if there is i < m such that ctj(s) <dj Oi(s') and %(s) = CLj(s') for all 
j < i. Observe that -< m is a well order on vertices of priority m. 

For any position v G W\ of priority m we now take the ^ m -minimal occurrence s{v) 
in T g and define ancestors by a(v) := a(s(v)). For v G V\ fl W\ we consider the unique 
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successor t of s(v) and set g'{v) := h(t). This defines a positional strategy g' for Player 1 
on Q. 

We claim that this strategy is winning on W\ . Suppose conversely that there is a losing 
play respecting the strategy. Then either no priority appears infinitely often on this play, 
or the smallest priority occurring infinitely often is even. 

If no priority occurs infinitely often, then we can proceed as in the proof of Theorem 13. 21 
to show that all ancestors eventually stabilise on the play, and thus obtain an infinite path 
in T g on which no priority appears infinitely often. This is impossible since g is a winning 
strategy for Player 1. If the minimal priority p appearing infinitely often is even, then 
we consider a suffix of the play that contains only priorities > p. By the same reasoning 
as in the first case it follows that all g-ancestors, for q < p, eventually stabilise on the 
play. Consider the suffix of the play after this has happened. A move from v to w on 
this suffix corresponds to a move from s(v) to t in T g . By definition, the p-ancestor of v is 
a p (v) = a p (s(v)) and a p (w) < p a p (t). On T g we obviously have a p {t) = t if Q(t) = p and 
a p{t) = a p( s ( v )) if > p. Now t is a descendant of a p (s), so by Lemma 14.21 we have 
t <p a p (s); for the case that Q(t) = p this means that a p (t) = t < p a p (s). Since -< p extends 
< p on nodes of priority p, we have that a p (w) < p a p (v) and that the inequality is strict if 
£l(w) = p. But on the suffix we have an inifinite sequence of positions with priority p, and 
hence an infinite -Kp-decreasing chain of p-ancestors, which is impossible. □ 

Remark: Parity games over larger ordinals. We can also define parity games with 
a priority function Q : V — > a taking values in a larger set of ordinals than uj. Recall that 
any ordinal can be written in a unique way as a sum A + n where A is a limit ordinal and 
n < uj. We call A + n even if n is. The question arises whether the positional determinacy of 
parity games over cj extends to larger ordinals. However, a tiny modification of the game in 
Proposition 12. 21 shows that this is not the case. Indeed, if we replace in that game priority 
by lo, and use the (min-)parity winning condition, then Player has a winning strategy from 
each position but no winning strategy with finite memory. For larger ordinals, a similar 
construction applies. This proves that parity games over ordinals a > uj in general do not 
guarantee finite memory winning strategies. 

Essentially the same construction shows that finite-memory determinacy also fails for 
some other variants of parity games over uj, such as 

• parity games where the priority function is partial (i.e., not all vertices have a 
priority) , 

• parity games with priorities on edges rather than vertices. 

5. MULLER GAMES 

Why do parity games and max parity games behave differently? Both are Muller 
conditions (i.e. they refer only to the set of priorities seen infinitely often) and the question 
arises which properties of Muller conditions are responsible for positional determinacy or 
determinacy with finite memory. In this section we assume that the set of priorities is 
countable. This is reasonable as on each play one can see only a countable number of them. 

Definition 5.1. A Muller condition over a set C of priorities is written in the form {J-q, J-\) 
where J-q C V(C) and T\ = V(C) — J-q. A play in a game with Muller winning condition 
(^o j J~i ) is won by Player a if, and only if, the set of priorities seen infinitely often in the 
play belongs to T a . 
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For infinity games, we have JF = {0} and T\ = V{u) — {$}. For parity games, 
Fo = {X C u : min(X) is even} U {0} 
T\ = {X C oj : min(X) is odd} 
For max-parity games, we have 

J-q = {X Q uj : if X is finite and non-empty, 

then max(X) is even} 
T\ = {X C uj : X is finite, non-empty, and 
max(X) is odd} 

Definition 5.2. We say that (J-q,J-\) guarantees positional winning strategies if all games 
with winning condition (J-q,J-\) are positionally determined. 

Following McNaughton [23] and Zielonka we say that T a has a strong split if there 
exist sets Xo, X\ £ with Xo C\X\ ^ and Xo UXi € J-\- a - Zielonka has shown that 
a Muller condition over a finite set of priorities guarantees positional winning strategies if, 
and only if, 

(PO): J-q and 3~\ have no strong splits. 

Remark. A weak split is a pair of disjoint sets with Xq,X\ € T a and Xo U X\ € J~i- a - 
Muller conditions over finite sets of priorities may have weak splits and still guarantee 
positional winning strategies. The simplest case is when J-q consists of the set {0, 1}, but 
{0} and {1} belong to T\. 

We want to find a similar characterisation of Muller conditions with positional winning 
strategies for the case of infinite sets of priorities. 

We observe that for infinity games and parity games J-q and T\ are closed under unions 
and non-empty intersections of chains: 

(PI): For every infinite descending chain X\ 2 X<i 2 • • • of elements of T a either 

C\i<uj Xi = or it is an element of 
(P2): For every chain X\ C X2 C . . . of elements of T a -, also \J i<LLj Xi belongs to T a . 
On the other side, for the max-parity condition, Tq is not closed under non-empty 
intersections of chains (take Xi = {1} U {n : n > i}) and T\ is not closed under unions of 
chains (take Xi = {j : j < 2i + 1}). Condition (PI) fails also for min-parity condition for 
ordinals a > uj. Indeed we have T\ = {X C a : min(X) is odd} which is not closed under 
non-empty intersections of chains (take Xi = {oj} U {n : 2i + 1 < n < uj}). 

We will show first, that condition (PI) is necessary for the positional determinacy of a 
Muller condition. 

Lemma 5.3. If there is an infinite sequence X\ 5 X2 2 ' • • of elements of J-\- a with 
f]Xi = Y 7^ and Y € T a then there is game with winning condition (^Oj-^i) that 
Player a wins, but needs infinite memory to do so. 

Proof. Consider the following game where circles denote positions of Player a and boxes 
positions of Player (1 — a). 
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Here a is some arbitrary element of Y. A play in this game is an infinite sequence of 
subplays; in each subplay Player a first decides from which Xi the opponent is going to 
choose next. After Player (1 — a) has made his choice, Player a can select an element from 
Y. 

If Player a allows her opponent to choose from some Xi infinitely often then Player (1 — 
a) can make all elements of Xi appear infinitely often on the play. This means that in order 
not to lose, Player a must permit Player (1 — a) to choose from each Xi only finitely often. 
If she does this then she wins as she can make sure that each element of Y is seen infinitely 
often thanks to the last part of the each subplay. Thus Player a has a winning strategy, 
but none that uses only finite memory. □ 

To show the necessity of conditions (PO) and (P2) we consider the following game. 




Here, Y is a set and a £Y. The arrows to the ovals with Y mean that the player can 
choose any element of Y. Clearly, if Y £ J- a , then Player a can win by visiting all elements 
of Y infinitely often. However, if Player a plays memoryless then she must select a fixed 
element b, and her opponent can chose an arbitrary set X C Y of nodes and make sure that 
the set of nodes visited infinitely often is {a, b} U X. More generally, if Player a plays with 
a finite memory strategy this amounts to selecting a finite set B; Player (1 — a) can then 
win if there exists a set X £ T\- a with {a} UBCIC7. 

Lemma 5.4. If T\- a contains a strong split, then there is a game with winning condition 
{To^Ti) that is won by Player a, but not with a positional strategy. 
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Proof. Let Xq U X\ G T a with Xq,X\ G and Xo H ^i 7^ 0. Take the game above 

with Y = Xq U X\ and a G -Xo H Xi. Player cr wins since Y = Xq U G JT^. However, 
she cannot win positionally. Indeed the single element b selected by a positional strategy 
of Player a belongs to Xi (i = or 1), and Player 1 — a can win by making sure that all 
elements of Xi, and only these, are visited infinitely often. □ 

Lemma 5.5. If T\- a is not closed under unions of chains, then there is a game with 
winning condition (Tq,J-\) that Player a wins, but needs infinite memory to do so. 

Proof. Let X\ C X<i C • • • be an infinite ascending chain in J-\— a with [J i Xi G J- a . Take 
the game described above with Y = Xi and a G X\. Again Player a wins since Y G T a - 
But if Player a plays with finite memory, this amounts to selecting a finite set B C Y 
of elements that she visits infinitely often. Since B is finite B C Xi for some i; hence 
Player 1 — a can make sure that the set of elements visited infinitely often is Xi and wins. □ 

In the remaining part of the section we will characterise the Muller conditions satisfying 
(PO), (PI) and (P2) in a different way, via Zielonka paths, and then show that any such 
condition can be reformulated as a parity condition over an ordinal a < u. In particular, 
this implies that these closure properties are necessary and sufficient to guarantee positional 
deter minacy on all game graphs. 

Definition 5.6. The Zielonka tree of a Muller condition (J-o,J-i) over C is a tree Z{Tq,J-i) 
whose nodes are labelled with pairs (X, a) such that X G T a . Let a be the player that wins 
with the set of all priorities, i.e. C G T a with C = (J ^oUlJ^l- The Zielonka tree Z{Tq, T\) 
exists, if for every maximal Y G T\- a the Zielonka tree Z(Tq fl V(Y),J r i n V(Y)) exists 
and every set in T\- a is a subset of some maximal set in T\- a - In that case Z{J-q,J-i) 
consists of a root, labeled by (C, cr), to which we attach as subtrees the Zielonka trees 
Z[Tq fl V(Y),J r i fl V(Y)), for the maximal sets Y G (In particular, if T\- a = 0, then 

the Zielonka tree consists of a single node.) 

For Muller conditions over a finite set C, the Zielonka tree always exists, and it is a 
fundamental tool for analysing the memory that is required for solving Muller games 
For infinite sets C, the Zielonka tree need not exist, since there is no guarantee, that for 
X G T a , the set V(X) U T\- a contains maximal elements. For instance the max-parity 
condition does not have a Zielonka tree. 

Proposition 5.7. For every Muller condition satisfying property (P2) the Zielonka tree 
exists. 

Proof. By (P2) the union over any chain Yq C Y\ C . . . in V(X) fl J- a is again contained 
V(X) fl J- a . Hence, by Zorn's Lemma, V(X) fl T a has maximal elements. 

Now let S be the set of elements of V(X) n T a that are not below a maximal element. 
For any Y G S there exists a set Y' ^)Y which must again belong to S. Further, the union 
over any chain in S is again contained in S. If S were non-empty, then, again by Zorn's 
Lemma, S would contain maximal elements, which is absurd. □ 

We say that a Muller condition {Tq^Ti) is described by a Zielonka path of co-finite sets 
if the Zielonka tree Z(Tq, J-\) exists, and it is a finite or infinite path, consisting of co-finite 
sets, and possibly the empty set at the end. 

Proposition 5.8. Every Muller condition on a countable set C , satisfying properties (PO), 
(PI), and (P2), is described by a Zielonka path of co-finite sets. 



POSITIONAL DETERMINACY 



13 



Proof. We already know that the Zielonka tree for {Tq^J-i) exists. The set that labels the 
root of the Zielonka tree is C which is co-finite. Consider now any node of the Zielonka tree, 
labelled (X, 1 — a). If all subsets of X belong to J-\— a (in particular if X = 0), then the 
node is a leaf of the Zielonka tree. Otherwise, by Proposition 15. 71 we know that V(X) nJ- a 
contains a maximal element Y. If X \ Y was infinite then one could consider any infinite 
descending chain X i D Xi 3 . . . of sets in V(X) n whose intersection is Y . But, 

unless Y = 0, this would violate property (PI). Hence, Y is either co-finite or empty. Now 
suppose that there are two distinct maximal elements Y±, Yi in V(X) n T a - Since Y\,Y<2 
are both co-finite, Y\ Pi Y2 ^ 0. By property (PO), Y± U Y2 G T a which is impossible by the 
maximality of Y\ and Yi- This means that the node (X, 1 — a) has a unique sucessor (Y, a), 
with Y being the greatest element in V(X) n ^v. 

Thus, the Zielonka tree is indeed a finite or infinite path of co-finite sets and, if it is 
finite, with possibly the empty set at the end. □ 

Next we have to make precise what it means that a Muller condition reduces to a parity 



Definition 5.9. A Muller condition (J-q,J-\) on C, with G J- a , reduces to a parity 
condition on a, if there is a function / : C — > a such that, 
(1) for every non-empty X <Z C we have that 



(2) / 1 (d) is finite for every d G a, unless d = max /(C) and d is even. 

Note that such a reduction may have to switch the role of the two players. Indeed, if 
6^1, then the role of Player 1 in the Muller game must be taken by Player in the parity 
game since, by convention, a play of a parity game in which no priority is seen infinitely 
often is won by Player 0. 

Proposition 5.10. If a Muller condition (J-q,J-\) reduces to a parity game on some a < u, 
then it guarantees positional winning strategies. 

Proof. Since (J^q^i) guarantees positional winning strategies if, and only if, (JFi,JFo) does, 
we may assume that G J-q. With the function / : C — > a we can relabel any Muller game 
Q with winning condition (J-q, J-\) to a parity game Q' on the same game graph. Since Q' is 
positionally determined it suffices to show that every play ir in Q is won by the same player 
as the corresponding play in Q' . Let X be the set of priorities occurring infinitely often in 
7T. In the corrsponding play in Q' , the set of priorities seen infinitely often is either f(X) 
or f(X) U {d}, where d = max /(C) is even. If X is empty, then so is f(X), and hence 
the minimal priority seen infinitely often in ir' is either d, which is even, or does not exist. 
Otherwise, X G J-q if, and only if, min/(X) is even. Hence Player wins ir if, and only if, 
she wins ir'. □ 

We want to prove that any Muller condition described by a Zielonka path of co-finite 
sets reduces to a parity condition. Before we do so, we illustrate the reduction by two 
examples. First, consider the case that, for certain a,b,c,d G u, 



condition. 




J-q = {X Cy:a£lVi)6lV{c 1 (i}nI = i} 
T\ = {X C lo : {a, 6}nX = 0A(cGXV(iG X)} 



The Zielonka path for (Fq^i) is 

(W,0) — H 



(u\{a,b},l) 



(u \ {a, b, c, 



4,0) 
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and we can immediately read off an appropriate reduction / from (J^q,^) to a parity 
condition with three priorities, namely /(a) = f(b) = 0, /(c) = f(d) = 1, and f{x) = 2 for 
all other x E u. However, if we change the condition just a little bit, by moving the empty 
set from Tq to J-\, the reduction becomes quite different. The Zielonka path now has the 
form 

(w, 0) — ► (u \ {a, b}, 1) — » ( w \ {a, 6, c, d}, 0) — (0, 1). 
Since E ^"i we have to change the role of the players. Moreover, we can no longer map 
all elements of co \ {a, b, c, d} to the same priority since a play in the Muller game may see 
this set infinitely often without seeing any of of its elements more than a finite number of 
times. Hence an appropriate reduction / : uj — > u is now defined by 

1 for x = a and x = b 

f{x) = < 2 for x = c and x = d 

2x + 3 for x E to \ {a, b, c, d}. 

Proposition 5.11. Every Muller condition that is described by a Zielonka path of co- finite 
sets reduces to a parity game on an ordinal a < u>. 

Proof. Let (Fo^Ti) be a Muller condition with E J-q. Otherwise we replace by 
(^i,^o)- 

The Zielonka path for (J^o-i^l) gives, for some < to a descending sequence (^i)o<i< / 3 
(in case C G Tq) or ) i<i</3 (in case C € ^i), which consists of co-finite sets, and possibly 
the empty set at the end, such that 

• Z2i G To, Z21+1 <E T\. 

• If Y C Zn and Y % Z21+1, then Y E ^o- Similarly, if Y C ^2^+1 and Y ^ ^2i+2i 
then 7 6^i. 

To define the reduction / : C — > a, we distinguish three cases. 

(1) If the Zielonka path is infinite, set a := w, and let /(c) be the biggest i€w such that 
c E 2j. Since Hie^ ^« = ^ this is well-defined. 

(2) If the Zielonka path is finite and does not end with the empty set, let a := (3 and 
define /(c) as in the first case. 

(3) If the Zielonka path is finite, and ends with ^2j+2 = 0, let a = w and define / : C — > co 
as follows. For i < 2j + 1 we put /(c) = i for all cE Zi\ Zi + \. For c E ^2j+i we define 
/(c) by means of a bijection from the (infinite) set Zij+\ to the set of yet unused odd 
priorities {2n + 1 : n > j}. 

Cleary, for any non-empty X, we have that X E J-q if, and only if, min/(X) is even. 
Further, /~ 1 (i) is infinite only in the case that f~ l (i) = Z% is the last set in the Zielonka 
path. In that case i is even and is the maximal element in the range of /. Hence / defines 
an appropriate reduction from [J-q^Ti) to a parity condition. □ 

We can now summarize the characterisation of the Muller conditions that guarantee 
positional determinacy. 

Theorem 5.12. For any Muller condition {Tq^i) over a countable set C of priorities, the 
following are equivalent. 

(1) {J-q,J-i) guarantees positional winning strategies. 

(2) J-q and J-\ are closed under union of chains, non-empty intersections of chains, and 
have no strong splits. 
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(3) (Tq^i) is described by a Zielonka path of co-finite sets. 

(4) (J~o,J-i) reduces to a parity condition on an ordinal a < u. 

Determinacy of Muller Games. Theorem 15.121 classifies the Muller conditions that 
imply positional determinacy on all game graphs. We remark that for Muller games, deter- 
minacy itself is an issue that deserves investigation. If either J-$ or T\ is countable, then 
the Muller condition {J-q,J-\) is Borel (on level S4 or II4), so determinacy follows from 
Martin's Theorem. In general however, Muller conditions over countable sets of priorities 
need not be Borel. This can be seen via a simple counting argument. There are only 2 N ° 
Borel sets since each of them is described by a countable infinitary formula. But there are 
2 2N<) Muller conditions. Indeed, on the basis of Boolean Prime Ideal Theorem, which is a 
weak form of the Axiom of Choice, it is not too difficult to construct non-determined Muller 
games. 

Theorem 5.13. There exist non- determined infinitary Muller games. 

Proof. We slightly modify a well-known construction of a non-determined Gale-Stewart 
game. The Boolean Prime Ideal Theorem implies that there exists a free ultrafilter 1 U C 
V(u)). Let T§ = U and construct a game graph such that by playing the game, the players 
define a strictly increasing sequence ao < ai < «2 < • • • , where the numbers a2 n are 
chosen by Player 0, and numbers a2 n +i by Player 1, such that precisely the priorities in 
x '■= Urtew( a 2n>«2n+i] are seen infinitely often. 

We claim that the resulting Muller game is not determined. Assume that Player has 
a winning strategy / which maps any increasing sequence ao < 0.1 < • • • < a,2n— 1 of even 
length to a2n = /(ao«i • • • «2n-l) > «2n-l- We consider two intertwined counter-strategies 
of Player 1, forcing essentially Player to simultaneously perform two plays against himself. 
In reply to the first move ao, Player 1 selects an arbitrary a\ > ao and then sets up the two 
plays as follows: In the first one she replies to ao by a\ and waits for the answer a2 = /(ao a i) 
by Player 0. She then uses ai as her own reply to ao in the second play and gets the answer 
a 3 = f{ a o a 2) by Player 0, which she now uses as her next move in the first play. There 
Player responds by 04 = f{aoa\a2a^) which is again used by Player 1 as her answer to 
aoa2 03 in the second play. And so on. 

In this way, the two infinite plays result in sequences ao < ai < a2 < . . . and ao < 
0-2 < a 3 < ■ ■ ■ ■ Since Player plays with his winning strategy in both plays, it follows that 
X = Une^( a 2n,«2n+i] G U, but also X' = (a ,o 2 ] U Un>o( a 2n+i, a 2n+2] G U. By closure 
under intersection, it follows that X D X' = (ao,ai] £ U. But U is a free ultrafilter, so it 
cannot contain a finite set. 

By almost precisely the same argument, it also follows that Player 1 cannot have a 
winning strategy. □ 

6. Further results 

6.1. Uncountable sets of priorities. In the previous section we have assumed that the 
set of all priorities is countable. However, it can be shown that the characterization of 

An ultrafilter in (P(u), C) is a set U C V(lo) that does not contain 0, that includes with any set also 
all its supersets, with any two sets also their intersection, and such that for any set x C uj either x € U or 
uj \ x £ U. An ultrafilter is free if it contains all co-finite sets. As a consequence, it does not contain any 
finite set. 
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the Muller conditions that guarantee positional winning strategies remains the same for 
uncountable sets of priorities. As in each play, there appear only countably many priorities, 
uncountable sets play no role in a Muller condition. Still, the argument is slightly more 
involved than in Theorem 15. 121 because we cannot start the construction from the set C of 
all priorities. Nevertheless, we can show that if every restriction of the Muller condition to 
a countable subset of C satisfies (PO), (PI), (P2) then it is equivalent to a parity condition. 
Let {J-q, J-\) be a Muller condition over an uncountable set C of priorities. 

Definition 6.1. A set X G J-q is called a 0-limit set if whenever X C X' then X' € J-q. 
Similarly for ldimit sets. 

Lemma 6.2. There exists a countable or 1-limit set. 

Proof. If not then we can construct an infinite increasing sequence of countable sets such 
that even indexed sets are from Tq and odd indexed sets are from T\. □ 

Lemma 6.3. // there is a 0-limit set then there is no 1-limit set. 

Proof. Otherwise there is a Odimit set X and a ldimit set Y. Consider XL)Y. By definition 
of limit sets it should belong to both Tq and T\. □ 

Lemma 6.4. Suppose that Y € J-\ and that Y U {a} 6 J-q is a 0-limit set. In this case {a} 
is a 0-limit set. 

Proof. Assume conversely that there is a Y' £ T\ containing a. We have Y UY' = Y L)Y' L) 
{a} € J-q by the assumption that FU{o} is a limit set. Let Y\ be the greatest element of T\ 
included in Y L)Y'; it exists by construction from Thm l5~T2l As Y, Y' € J~i, we have then 

Y CYi and Y' C Yi, but this is impossible as it implies that Y\ = Y U Y' € Tq n T\ = 0. □ 

Lemma 6.5. For every limit set X there is a priority a € X such that {a} is a limit set. 

Proof. Take a limit set X £ J-q and the greatest set Y C X from T\. The set D := X \Y is 
finite by the construction from Thm 15.121 Take an arbitrary element a G D. If Y U {a} is a 
0-limit set then we are done by the previous lemma. If not then we take Y' £ J-\ containing 

Y U {a}. Then we take a next priority b G D and consider Y' U {6}. As D is finite and 

Y U D = X is a limit set we can repeat these steps at most \D\ number of times. □ 

The above lemma allows to introduce the notion of a limit priority. Let us remove all 
the limit priorities from C and consider the Muller condition (^-q, J-[) obtained by restricting 
(^0,^1) to this set of priorities. Clearly it also satisfies the conditions PI, P2, P3. 

Lemma 6.6. In (J 7 ^,^) there is no limit set from J-q. 

Proof. If there were a limit set in Tq then this set would be also a limit set with respect 
to the original condition (JF ,J-\). But then it would contain a limit priority which is 
impossible by the definition of {F^T^). □ 

Hence in (Fq,J~[) there is a limit set in T\ and we can choose limit priorities for the 
other player. Repeat the construction for uj steps. We obtain a sequence of nonempty sets 
of priorities A\ , B\ , . . . . If after u> steps the set of remaining priorities is nonempty then 
we take a countable subset R of the priorities that are left and have a decreasing sequence 
Ri,Pt2, ■ ■ ■ , where Rn-\ = \J{ a ii ai+i, ...}L)R and R 2 i = \J{bi, o i+1 , b i+1 , ...}UR. 
But the existence of such a sequence contradicts the condition PI. 



POSITIONAL DETERMINACY 



6.2. Games of bounded degree. The question arises whether the class of winning condi- 
tions that guarantee positional winning strategies becomes larger if we only consider game 
graphs of finite degree, or game graphs of finite and bounded degree. In particular this 
question has been asked for max-parity games and for parity games over larger ordinals 
than uj, where the counter-example that we have presented has infinite degree. It turns 
out that parity games over u + 1 are determined, while those over uj + 2 are not. How- 
ever, it seems quite difficult to give an exact characterisation of the Muller conditions that 
guarantee positional winning strategies on all game graphs of bounded finite degree. 

Proposition 6.7. Max-parity games with infinitely many priorities in general do not admit 
finite memory strategies, even for solitaire games and even for game graphs with maximimal 
degree two. 

Proof. Consider the following game where every vertex has degree one or two. 




Assuming the max-parity winning condition it is obvious that there is an infinite mem- 
ory strategy for Player to enforce that the set of priorities seen infinitely often is {1,2}, 
but that any finite memory strategy is losing. □ 

The same construction works for (min-)parity games on ordinals a > uj + 1. Indeed, if 
we replace priorities 2 and 1 by u; and u + 1, we obtain a min-parity game that requires an 
infinite memory winning strategy. 

However there is an interesting case where parity games of bounded degree behave 
differently than games of unbounded degree. 

Theorem 6.8. Parity games of bounded degree with priorities in uj + 1 are positionally 
determined. 

Proof. We first consider the case of Player 1. Extending the argument from Theorem 14.31 
we show that in any parity game with priorities in uj + 1, Player 1 has a positional winning 
strategy on his winning region. Note that for this case we do not need the assumption of 
bounded degree. 

Let Q a parity game with priorities in uj + 1, let g be a winning strategy for Player 1 
on his winning region in Q and let T g be the associated strategy forest. In the following, 
positions labeled by uj will be called uj -positions and the other positions will be called natural 
positions. Since every path through T g is winning for Player 1, it must contain infinitely 
many natural positions. This means that the definitions of 1-signatures that we have used 
in the proof for parity games on uj carry over here. Recall that <j denotes the signature 
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order (which is strict and partial). Let <dj be a total well-order extending <j, and assume 
that _L is the biggest element in this order. 

As in the proof of Theorem 14.31 we associate with every node s of T g of priority m < to 
the (m + l)-tuple a(s) = (ao(s), . . . ,a m (s)) G (T g U {_L}) m+1 of ancestors. As before, we 
write s -< m s' if there is i < m such that aj(s) <j ai(s') and Oj(s) = aj(s') for all j < i 
Observe that -< m is a well-order on vertices of priority m. For a position u of priority m we 
now take the -< m -minimal representant of v in T g , i.e., the minimal s with /i(s) = v where 
h is the canonical homomorphism from T g to Q. We denote this representant by s{v). We 
can also define the tuple of ancestors by a(v) = a(s(v)). 

In order to define s(v) for positions of priority co we use -< m to compare vertices in T g 
of different, but finite, priority. We define s -< s' if either s -< m s' for m being the minimum 
of the priorities of s and s', or the tuple (ao(s), . . . , a m (s)) has (ao(s')> • • • > a m'( s ')) as a 
strict prefix. We claim that this is a well-ordering on vertices of finite priority. To reason 
by contradiction, suppose that there is an infinite descending chain sq y s± >~ . . . in this 
ordering. Let us look at the chain ao(so)> Qo(si), • • • of first elements of the tuples. This 
chain is not increasing in the <o-° r( i er i n g> so it must eventually stabilise on some element 
ao- Let iq be the position where it stabilises. Observe that this implies that there cannot 
be a vertex of priority after sq. By a similar argument we find a\ that stabilizes after ao 
stabilizes. Continuing like this we get an infinite sequence ao, a%, ■ ■ ■ ■ Observe that infinitely 
many of the elements in the sequence are not _L. Indeed, there are vertices of infinitely many 
priorities, and when we see a vertex s of priority i then at(s) is not _L so ai cannot be _L. 
To finish the argument we observe that for each i = 0, 1, . . . , if Oj ^ _L then it is a vertex of 
priority i and it is an ancestor of all dj ^ _L for j > i. Moreover, there can be no vertices 
of priority i between ai and dj ^ _L for j > i. Thus, the sequence ao, a±, . . . determines an 
infinite path in T g where no priority, except possibly u, appears infinitely often. This is a 
contradiction as we have assumed that all paths in T g are winning for Player 1. 

There are two more notions that we need. For each vertex s G T g of priority u we 
define the max- distance to be the maximal length of a path of w-vertices starting from s. 
This is well defined as on every path from s there is eventually a vertex of a finite priority. 
Secondly, for s we define its anchor to be the closest ancestor of finite priority. 

Now we are ready to define s(v) for positions v of priority u. Among all the represen- 
tants of v, i.e., vertices s such that h(s) = v, we choose one with the ^-smallest anchor. If 
there are more than one with this property then among them we choose the one with the 
smallest max-distance. If this still does not identify a unique representant then we choose 
one arbitrarily. 

Having defined s(v) for all v in the winning region for Player 1 in Q we define a positional 
strategy g'. We set g'(v) = h(t) where t is the unique successor of s(v) in T g . We claim 
that this strategy is winning. Suppose conversely that there is a loosing play respecting the 
strategy. Then either no natural number appears infinitely often or the smallest number 
appearing infinitely often is even. 

If no natural number appears infinitely often then we proceed as in the proof of The- 
orem 13.21 Consider the suffix of the play after the last appearance of priority 0. Let us 
look at 0-ancestors of the positions in this suffix. These ancestors can only get smaller as 
the play proceeds. This means that from some moment all positions in the play will have 
the same 0-ancestor. Next, we find a position where the 1-ancestor stabilizes. Observe that 
it will be a descendant of the 0-ancestor and that there will be no occurrences of priority 
between the two. Proceeding this way we construct a path in the strategy tree T g on 
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which no priority, accept possibly u, appears on infinite number of times. Notice, that it is 
important for this argument that the sequences of cu-nodes are finite. The remaining case 
when the smallest number appearing infinitely often is even is very similar to that from the 
proof of Theorem 14.31 

To show that Player can win with a positional strategy we transform a game Q with 
priorities from uj + 1 into a game Q and then to Q, such that Q has no w-positions. Then 
we translate the positional winning strategy form Q to Q. 

We first describe the transformation from Q to Q . Take a position s of Q labeled with 
u. For any i € uj U {uj} consider a gadget K\: 



Each round vertex represents a strategy of Player 1 from s permitting him to leave the 
region of w-labeled positions. The oval below such a vertex represents the possible exits, 
i.e., the natural positions that Player can reach when Player 1 uses the chosen strategy. 
Observe that if Player has a strategy to stay in ^-positions then the root of has no 
successors. To be conform with our definition of the game, in this case we assign a priority 
to the root of Kg and add a self-loop. This way we make it winning for Player 0. We call 
such a gadget degenerate. 

The transformation from Q to Q is the following. Take an ^-position s and replace it 
by the gadget K^ . The leaves of this gadget are natural positions in Q, hence we only add 
one position of Player 1 and some positions of Player 0. Redirect every arrow going from a 
natural position to s to the root of Kg. Repeating this for all ^-positions (of the game Q) 
we obtain the game Q. This game has the property that sequences of w-vertices can have 
length at most 2. Moreover there is an easy correspondence between strategies in Q and Q. 

Next we describe the transformation from Q to Q. The idea is to eliminate the priorities 
uj. If we come to a gadget from a position of priority i then we can as well assume that 
we see i in place of uj. The result of an infinite play will be the same as we at most triple 
the number of z's seen. For example, if uj was the only priority appearing infinitely often 
then after the change no priority at all would appear infinitely often, which gives the win 
to the same player. The transformation from Q to Q is as follows. For each priority % E uj 
and each non-degenerate gadget Kf we create a gadget K\, which has priority uj replaced 
by the priority i. For each position u of priority i in Q with an arrow to the root of Kg we 
redirect this arrow to the root of K\. Of course we need not to create K\ if there are no 
such u. Repeating this procedure for each gadget Kg we get rid of all positions of priority 
uj. The result is the game Q. 

There is a canonical homomorphism h : Q —> Q which maps the root of K\ to the root 
of Kg. It should be clear that there is a winning strategy in G if, and only if, there is one in 
G (the image of a path is winning for Player if, and only if, the path is a winning play for 
Player 0). As in G there are no vertices of priority uj we know that Player has a positional 
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winning strategy on his winning region. We will show how to translate it into a positional 
winning strategy in G (using G on the way). 

Take a positional winning strategy / for Player in G. Consider the signature as- 
signment in G defined by the strategy (as described in the section on parity games). This 
defines a signature assignment on natural positions of Q. It remains to define signatures 
for ^-positions and then use it to define a winning strategy. For each w-position s consider 
the gadget K\ for some i. If the gadget is degenerated then in Q Player has a strategy 
from s to stay in w-positions. We are done in this case as we can assume that Player has 
one global positional strategy on all vertices with this property. We call such s immediately 
winning. Suppose then that K\ is not degenerate and / is winning from its root. Each leaf 
of the gadget has assigned a signature. We can define the signature of s, denoted also by 
sig (s), by taking inf in nodes of Player in K\ and then sup in s. Here inf and sup are 
in the lattice of w-vectors of ordinals. Observe that sig°(s) does not depend on the choice 
of i in K\. In order to have a uniform notation let <^ denote the standard lexicographic 
ordering on w-tuples of ordinals. Notice that this is not a well-order while for i € u 
are. With this definition of signatures we have that if s is a position of Player 1, then for 
every successor t that is not immediately winning we have sig(i) sig(s) where i is a 
priority of s. Similarly, if s is a position of Player 0, then it has a successor t which is either 
immediately winning or satisfies the same property. Having this property we can define a 
positional strategy for Player that consists of choosing the smallest possible signature. 
The proof that this strategy is winning is the same as in the case of parity games. 

This theorem indicates that when we limit ourselves to game graphs of finite degree the 
class of Muller conditions guaranteeing positional winning strategies becomes larger. There 
also exist Muller conditions that do not reduce to parity conditions over any ordinal but 
still guarantee positional winning strategies on all game graphs of finite degree. For finite 
sets of priorities, such examples are well-known. In the simplest one, the set of priorities is 
C = {0, 1}, with T = {{0, 1}} and T x = {{0}, {1}}. 

Similar examples with an infinite set of colours can be constructed as follows. Let Y 
be any infinite set with e Y and set C = Y U {e}. Put 

To = V{Y) U {{e}} U {0} Ti = {Z : e € Z A Z n Y + 0} 

It should be clear that ( J-q ,T\) is not equivalent to a parity condition because each 
priority individually is winning for Player 0. By arguments that are similar to the proof of 
Theorem 16.81 one can show that such a condition guarantees positional determinacy on all 
game graphs of finite degree. 

It is an open problem to give a complete characterisation of all such conditions. 

6.3. Finite appearance of priorities. We may also ask whether the characterisation of 
positionally determined Muller conditions changes if we only consider games where _1 (c) 
is finite for every priority c. This is not the case. Indeed, the counter-examples for prop- 
erties (P0) and (P2) are games with this property, and in the counter-example for (PI) we 
can easily eliminate infinite occurrences of priorities. Consider the figure in the proof of 
Lemma 15.31 It suffices to omit the sets X2, X3, . . . and redirect, for every i > 2, each arrow 
from a to an element Xi € Xj to the element xi E X\. 
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6.4. Related work. There has recently been some interesting research on similar questions 
for games in somewhat different settings. For instance, Colcombet and Niwihski jKj have 
studied positional determinacy of games where edges, rather than vertices are labeled by 
priorities. This changes the situation completely. For instance, it is easily seen that there 
are edge-labeled parity games with infinitely many priorities that require winning strategies 
with infinite memory. Also there are some very simple non-Muller winning conditions that 
guarantee positional determinacy on vertex-labeled games but fail to do so on edge-labeled 
ones. An example is the set (0 + l)*(01) aJ whare Player has to make sure that from some 
point onwards the priorities and 1 alternate. If she can achieve this on a vertex-labelled 
game then she can also do this positionally. However, when the priorities are on the edges, 
then this is not the case: consider the game with a single vertex and two self-loops with 
priorities and 1. In fact, Colcombet and Niwihski prove that the only prefix-independent 
winning conditions that guarantee positional determinacy on all edge-labeled game graphs 
are precisely the parity conditions with a finite number of priorities. In a similar vein, 
Kopczynski [20] characterises the winning conditions that guarantee positional determinacy 
for one player on edge-labeled game graphs. 

Serre |22j exhibits examples of winning conditions on a countable set of priorities that 
have high Borel complexity, but still admit positional winning strategies. Recall that in our 
setting, if the set of priorities is countable then the conditions are at most at levels £4 or 
H4 of the Borel hierarchy. 

Gimbert and Zielonka ^Hj consider edge-labeled games with real valued pay-offs. They 
characterise those pay-off functions that guarantee optimal positional strategies for both 
players on all finite game graphs. As in the case studied by Colcombet and Niwihski the 
payoffs are on edges and not on vertices. 
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